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a convex combination of random walks on the free factors. We prove the existence of the 
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1. Introduction 

Suppose we are given a finite family of finite or countable sets V\,...,V r with distinguished 
vertices Oj G Vi for i E {1, . . . , r}. The free product of the sets Vi is given by V := V\*. . .*V r , 
the set of all finite words of the form x\...x n such that each letter is an element of 
Ui=i Vi \ {°i} an d two consecutive letters arise not from the same Vi. We consider a 
transient Markov chain (X n ) ng pj on V starting at the empty word o, which arises from a 
convex combination of transition probabilities on the sets Vi . Denote by 7r n the distribution 
of X n . We are interested in whether the sequence E[— \ogTT n {X n )\/n converges, and if so, 
to compute this constant. If the limit exists, it is called the asymptotic entropy. In this 
paper, we study this question for random walks on general free products. In particular, 
we will derive three different formulas for the entropy by using three different techniques. 

Let us outline some results about random walks on free products: for free products of finite 
groups, Mairesse and Matheus [2l[ computed an explicit formula for the rate of escape 
and asymptotic entropy by solving a finite system of polynomial equations. Their result 
remains valid in the case of free products of infinite groups, but one needs then to solve an 
infinite system of polynomial equations. Gilch [111 ] computed two different formulas for the 
rate of escape with respect to the word length of random walks on free products of graphs 
by different techniques, and also a third formula for free products of (not necessarily finite) 
groups. The techniques of [ill ] are adapted to the present setting. Asymptotic behaviour of 
return probabilities of random walks on free products has also been studied in many ways; 
e.g. Gerl and Woess lid], [281], Sawyer [241 ]. Cartwright and Soardi [3], and Lalley 181 ] . 
Candellero and Gilch [4j. 

Our proof of existence of the entropy envolves generating functions techniques. The tech- 
niques we use for rewriting probability generating functions in terms of functions on the fac- 
tors of the free product were introduced independently and simultaneously by Cartwright 
and Soardi [5J], Woess [28|], Voiculescu [27|] and McLaughlin [22|. In particular, we will see 
that asymptotic entropy is the rate of escape with respect to a distance function in terms 
of Green functions. While it is well-known by Kingman's subadditive ergodic theorem (see 
Kingman [17j]) that entropy (introduced by Avez [l]) exists for random walks on groups 
whenever E[— log7Ti(Xi)] < oo, existence for random walks on other structures is not 
known a priori. We are not able to apply Kingman's theorem in our present setting, since 
we have no (general) subadditivity and we have only a partial composition law for two 
elements of the free product. For more details about entropy of random walks on groups 
we refer to Kaimanovich and Vershik 14(] and Derriennic [7]. 



An important link between drifts and harmonic analysis was obtained by Varopoulos [2f 
He proved that for symmetric finite range random walks on groups the existence of non- 
trivial bounded harmonic functions is equivalent to a non-zero rate of escape. Karlsson and 



Ledrappier 16|] generalized this result to symmetric random walks with finite first moment 
of the step lengths. This leads to a link between the rate of escape and the entropy of ran- 
dom walks, compare e.g. with Kaimanovich and Vershik |l4j ] and Erschler [8J. Erschler and 
Kaimanovich [9] asked if drift and entropy of random walks on groups vary continuously on 
the probability measure, which governs the random walk. We prove real-analyticity of the 
entropy when varying the probabilty measure of constant support; compare also with the 
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recent work of Ledrappier [19|], who simultaneously proved this property for finite-range 
random walks on free groups. 

Apart from the proof of existence of the asymptotic entropy h = lim n ^.oo E[— log ir n (X n )]/n 
(Theorem I3.7p . we will calculate explicit formulas for the entropy (see Theorems 13.71 [3THI 
15.11 and Corollary 14. 2\i and we will show that the entropy is non-zero. The technique of 
our proof of existence of the entropy was motivated by Benjamini and Peres [2|, where 
it is shown that for random walks on groups the entropy equals the rate of escape w.r.t. 
the Greenian distance; compare also with Blachere, Hai'ssinsky and Mathieu [3j. We are 
also able to show that, for random walks on free products of graphs, the asymptotic en- 
tropy equals just the rate of escape w.r.t. the Greenian distance (see Corollary 13.31 in view 
of Theorem I3.7p . Moreover, we prove convergence in probability and convergence in L\ 
(if the non-zero single transition probabilities are bounded away from 0) of the sequence 

— i log7r n (X n ) to h (see Corollary 13. lip , and we show also that h can be computed along 
almost every sample path as the limes inferior of the aforementioned sequence (Corol- 
lary [3j)]). In the case of random walks on discrete groups, Kingman's subadditive ergodic 
theorem provides both the almost sure convergence and the convergence in L\ to the as- 
ymptotic entropy; in the case of general free products there is neither a global composition 
law for elements of the free product nor subadditivity. Thus, in the latter case we have 
to introduce and investigate new processes. The question of almost sure convergence of 

— logir n (X n ) to some constant h, however, remains open. Similar results concerning ex- 
istence and formulas for the entropy are proved in Gilch and Miiller [12] for random walks 



on directed covers of graphs. The reasoning of our proofs follows the argumentation in 12|: 
we will show that the entropy equals the rate of escape w.r.t. some special length function, 
and we deduce the proposed properties analogously. In the present case of free products of 
graphs, the reasoning is getting more complicated due to the more complex structure of 
free products in contrast to directed covers, although the main results about existence and 
convergence types are very similar. We will point out these difficulties and main differences 
to |12j at the end of Section 13.21 Finally, we will link entropy with the rate of escape and 
the growth rate of the free product, resulting in two inequalities (Corollary 16. 4j) . 

The plan of the paper is as follows: in Section [2] we define the random walk on the free 
product and the associated generating functions. In Section [3] we prove existence of the 
asymptotic entropy and give also an explicit formula for it. Another formula is derived 
in Section 2] with the help of double generating functions and a theorem of Sawyer and 



Steger 25J] . In Section [5] we use another technique to compute a third explicit formula for 
the entropy of random walks on free products of (not necessarily finite) groups. Section [6] 
links entropy with the rate of escape and the growth rate of the free product. Sample 
computations are presented in Section [7J 

2. Random Walks on Free Products 

2.1. Free Products and Random Walks. Let X := {1, . . . , r} C N, where r > 2. For 
each i € X, consider a random walk with transition matrix Pi on a finite or countable state 
space Vi. W.l.o.g. we assume that the sets V{ are pairwise disjoint and we exclude the case 
r = 2 = \Vi\ = J V2 1 (see below for further explanation). The corresponding single and 



4 ASYMPTOTIC ENTROPY OF RANDOM WALKS ON FREE PRODUCTS 

n-step transition probabilities are denoted by pi(x,y) and p\ f 1 (x,y), where x,y G Vi. For 
every i G I, we select an element Oj of V^ as the "root". To help visualize this, we think 
of graphs Xi with vertex sets V{ and roots Oj such that there is an oriented edge x — > y if 
and only if Pi(x, y) > 0. Thus, we have a natural graph metric on the set V{. Furthermore, 
we shall assume that for every i €l and every x G V% there is some n x G N such that 
p\ i \°ii x ) > 0- F° r sa ^e of simplicity we assume J>i(x, x) = for every i £ 1 and xG Vj. 
Moreover, we assume that the random walks on Vi are uniformly irreducible, that is, there 
are £q > and Ki G N such that for all x, y G 14 

(2.1) pi(x,y) > => p^ (x,y) > Eq for some A; < Ki. 

(i) 

We set iT := max^x Ki and £o := minj g j£Q . For instance, this property is satisfied for 
nearest neighbour random walks on Cayley graphs of finitely generated groups, which are 
governed by probability measures on the groups. 

Let V* :=Vi\ {oj} for every iEl and let V^ x := Ujgj^i*- The free product is given by 

V := V\ * . . . * V r 

(2.2) = |xix 2 ...x n n G N, Xj G V? , Xj G V^ => x j+1 £ V k x } U |o} . 

The elements of F are "words" with letters, also called blocks, from the sets V* such 
that no two consecutive letters come from the same Vi. The empty word o describes the 
root of V. If u = u\ . . . u m G V and v = v\ . . . v n G V with u m G Vi and v\ ^ Vi then 
uv stands for their concatenation as words. This is only a partial composition law, which 
makes defining the asymptotic entropy more complicated than in the case of free products 
of groups. In particular, we set uoi := u for all i G I and ou := u. Note that Vi C V 
and Oj as a word in V is identified with o. The WocA; length of a word n = u\ . . . u m is 
given by ||w|| := m. Additionally, we set ||o|| := 0. The type t(u) of u is defined to be i 
if u m G V^ x ; we set t{o) := 0. Finally, u denotes the last letter u m of u. The set V can 
again be interpreted as the vertex set of a graph X ', which is constructed as follows: take 
copies of X\, . . . X r and glue them together at their roots to one single common root, which 
becomes o; inductively, at each vertex v\...Vk with Vk G Vi attach a copy of every Xj, 
j ^ i, and so on. Thus, we have also a natural graph metric associated to the elements 
in V. 

The next step is the construction of a new Markov chain on the free product. For this 
purpose, we lift Pi to a transition matrix Pi on V: if x G V with r(x) ^ i and v,w G Vi, 
then pi(xv, xw) := Pi(v, w). Otherwise we set p%{x, y) := 0. We choose < a\, . . . , a r G M. 
with Yliei ai = !• Then we obtain a new transition matrix on V given by 

P = Y^a l P l . 

iei 

The random walk on V starting at o, which is governed by P, is described by the sequence 
of random variables (X n ) n€ fq . For x,y G V, the associated single and n-step transition 
probabilities are denoted by p(x,y) and p( n '(x,y). Thus, P governs a nearest neighbour 
random walk on the graph X, where P arises from a convex combination of the nearest 
neighbour random walks on the graphs Xi. 
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Theorem 3.3 in [llj] shows existence (including a formula) of a positive number £q such 
that £o = lim^^oo ||X n ||/n almost surely. The number £q is called the rate of escape w.r.t. 
the block length. Denote by 7r ra the distribution of X n . If there is a real number h such that 

h= lim -E[-log7T n (X n )l, 

n—too n 

then h is called the asymptotic entropy of the process (X n ) ne ^ ; we write No := N \ {0}. 
If the sets Vi are groups and the random walks Pi are governed by probability mea- 
sures /ij, existence of the asymptotic entropy rate is well-known, and in this case we even 
have h = \\m n ^ f00 —-\ogir n {X n ) almost surely; see Derriennic [7[ and Kaimanovich and 
Vershik |l4J . We prove existence of h in the case of general free products. 

2.2. Generating Functions. Our main tool will be the usage of generating functions, 
which we introduce now. The Green functions related to Pi and P are given by 



Gi(xi,yi\z) := ^pf^x^yi) z n and G(x,y\z) := ^p (n) (x,y) 



n>0 n>0 



where z E C, Xi,yi G Vi and x,y £ V. At this point we make the basic assumption that 
the radius of convergence R of G(-,-\z) is strictly bigger than 1. This implies transience 
of our random walk on V. Thus, we may exclude the case r = 2 = |Vi| = |V2|, because we 
get recurrence in this case. For instance, if all Pi govern reversible Markov chains, then 
R > 1; see [29l . Theorem 10.3]. Furthermore, it is easy to see that R > 1 holds also if there 

is some i £ I such that p\ n (oj, Oj) = for all n S N. 

The first visit generating functions related to Pi and P are given by 

Fi(xi,yi\z) := J>[r« = y h Vm < n - 1 : F« / Vl \ Y^ = Xi ]z n and 

n>0 

' ■ - x\z n , 



F(x,y\z) := ^P[X n = y, Vm < n - 1 : X m + y | X 



n>0 

where (Yn ) N describes a random walk on Vi governed by P{. The stopping time of the 
first return to o is defined as T := inf{m > 1 | X m = o}. For i €l, define 



OLi z 



H i (z):=Y j nTo = n,X 1 <£V t x }z n and ii{z) := - 

We write also & := ^(1), £ min := min ie j^ and ^ max := max ie x^. Observe that ^» < 1; 
see III, Lemma 2.3]. We have F(xi,yi\z) = Fi(xi,yi\£i(z)) for all Xi,yi G Vf, see Woess 



[29|, Prop. 9.18c]. Thus, 






1 - Ejei\{i} T^seVj a jPj(°Ji s ) zF j{ s ,°j\Zj( z )) ' 

For x% G Vi and x G V, define the stopping times T^V := inf{m > 1 | Ym = x{\ and 
T x := inf{?n > 1 [ X m = x}, which take both values in N U {00}. Then the last visit 
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generating functions related to P{ and P are defined as 

n>0 

L(x,y\z) := ^F[X n = y,T x > n \ X = x] z n . 

n>0 

If x = x\ . . . x n , y = x\ . . . x n x n+ \ G V with r{x n+ \) = i then 

(2.3) L(x,y\z) = Li(oi,x n+ i \d(z)); 

this equation is proved completely analogously to [29j, Prop. 9.18c]. If all paths from x £ V 
to w G V have to pass through y G V, then 

L(x,w\z) = L(x,y\z) ■ L(y,w\z); 

this can be easily checked by conditioning on the last visit of y when walking from x to w. 
We have the following important equations, which follow by conditioning on the last visits 
of Xi and x, the first visits of y. L and y respectively: 

Gi[%ii yi\ z ) = (-ri\Xi,Xi\z) ■ Li[Xi,yi\z) = Fi[Xi,yi\z) ■ Gi{yi,yi\z), 
(2.4) 

G(x,y\z) = G(x,x\z) ■ L(x,y\z) = F(x,y\z) -G(y,y\z). 

Observe that the generating functions F(-, -\z) and L(-, -\z) have also radii of convergence 
strictl bigger than 1. 

3. The Asymptotic Entropy 

3.1. Rate of Escape w.r.t. specific Length Function. In this subsection we prove 
existence of the rate of escape with respect to a specific length function. From this we will 
deduce existence and a formula for the asymptotic entropy in the upcoming subsection. 

We assign to each element X{ EVi the "length" 

k(xi) := -logL(o,Xj|l) = - log Li(oi,Xi\£i). 

We extend it to a length function on V by assigning to v± ... v n € V the length 

n n 

l(vi ...v n ) := ^2 l r(vi)(vi) = -^logL(o,«i|l) = -\ogL(o,vi...v n \l). 
i=l i=\ 

Observe that the lengths can also be negative. E.g., this can be interpreted as height 
differences. The aim of this subsection is to show existence of a number l G R such that 
the quotient l(X n )/n tends to £ almost surely as n — > oo. We call I the rate of escape w.r.t. 
the length function /(•). 

We follow now the reasoning of [ill, Section 3]. Denote by Xn the projection of X n to 
the first k letters. We define the k-th exit time as 

efc := minjm G No I Vn > m : X n ' is constant}. 

Moreover, we define W^ := X ek , r^ := r(Wfc) and k(n) := max{A; G No | e^ < n}. We 
remark that \\X n \\ — > cxo as n — > cxd, and consequently e^ < oo almost surely for every 
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fceN; see [ll|, Prop. 2.5]. Recall that W& is just the laster letter of the random word X ek . 
The process (Tk)keN is Markovian and has transition probabilities 

aj & 1 - £j ( 1 



]{hj) OiZjl-zMl-ZAGiipiiOtei) 1 



for i ^ j and q(i,i) = 0; see 111, Lemma 3.4]. This process is positive recurrent with 
invariant probability measure 

„(i) = C- 1 ■ " i(1 " &) (1 - (1 - &)Gi( 0i , Oi|6)) , 

si 

where C := ^ " i(1 ~ ^ (l - (1 - &)Gi(oi,Oi|&)); 
iex « 

see [111 . Section 3]. Furthermore, the rate of escape w.r.t. the block length exists almost 
surely and is given by the almost sure constant limit 

£q = lim — — = lim — = r— 



(see [ill, Theorem 3.3]), where 



Lemma 3.1. T/ie process (Wfc,Tfc), N is Markovian and has transition probabilities 

q((g,i),(h,j)) = I"**' 1 6 . 

[0, tf* = j. 

Furthermore, the process is positive recurrent with invariant probability measure 

n(g,i) = ^2is(j)q({*,j),(g,i)). 

Remark: Observe that the transition probabilities q((g,i),(h,j)) of (W&,7>.) fc N do not 
depend on g. Therefore, we will write sometimes an asterisk instead of g. 



Proof. By [ll|, Section 3], the process (Wfc,efc — efc_i,Tfc) fe N is Markovian and has tran- 
sition probabilities 

10, if* = Jl, 
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where fcj n) (s) := ¥[X n = s, VI < n : X t £ V t x \X = o] for s G V? \ Vj. Thus, (W k ,T k ) km 
is also Markovian and has the following transition probabilities if i ^ j: 



1 ~^J sr ST iM- 1 ), 



q{(g,i),(h,j)) = ^g(( 5 ,*, ? ),(/ l ,n, J ))= T -|^^fcr 1) ( S M S ,/ J ) 



n>l 



In the third equality we conditioned on the last visit of o before finally walking from o to s 
and we remark that h 6 V x . A straight-forward computation shows that ir is the invariant 

probability measure of (W^, ^),^, where we write .4 := {(#, i) | z € X, g € V^ x }: 



E ir(g,i)-q((g,i),(h,j)) = E E i/(fc) ■ g((*, fc), (#,z)) • ?((*,*), (^j)) 

= 5>(om),(m)E^) E «((*>*)> &o) 

= e^cmm^E^-^m) 

iex fcex 



i&X 



□ 



Now we are able to prove the following: 
Proposition 3.2. There is a number £ € IR such that 

£ = lim — almost surely. 

n— ¥oo n 

Proof. Define h : A ->■ R by %,j) := %). Then £* =1 MW a ,t>) = £a=i*(Wa) = 
/(Wfe). An application of the ergodic theorem for positive recurrent Markov chains yields 



k 

^=A ? E /i ( W A^A) >C7,:=y, 



if the integral on the right hand side exists. We now show that this property holds. Observe 
that the values Gj(oj,g\£j) are uniformly bounded from above for all (g, j) £ A: 



Gsio^gfc) = E>f(°i>*)tf < ^ < ^ 



n>0 



» 



For g e V^ x , denote by |#| the smallest n € N such that p r( Jo T ^,g) > 0. Uniform 
irreducibility of the random walk Pj on V{ implies that there are some Eq > and K € N 



ASYMPTOTIC ENTROPY OF RANDOM WALKS ON FREE PRODUCTS 9 

such that for all j G T, Xj , yj G Vj with p 3 (xj , yj ) > we have p- (xj ,yj) > Eq for some 
k < K. Thus, for (g,j) £ A we have 



G 3 {o 3 ,g\i 3 )>e^kf K >(e Q ^ 9 y 

Observe that the inequality \g\ ■ | log (eq £^j n ) I < fog 1/(1 ~~ W) holds if and only if 
\g\ < log(l - ^ max )/log(e Cmm)- Define the sets 



M^ 



/ ^ T/ x I i s fog(l - Uax \ A/f / _ T , x | | . fog(l - £max) \ 

:=\g€V, \g\> - K \, M 2 := \g G V* \g\ < - K \ 

1 fog(eoCm) J l lo g( £ 0Cin) J 

Recall Equation (|2.4p . We can now prove existence of J /id7r: 

\h\dn = ^ \ l °S L j(°j^9\S,j)\-^(9,J) 
(gJ)eA 

- ^2 \^>sGj(oj,g\^j)\"ir(g,j)+ ^ \logGj(oj,Oj\£j)\-n(g,j) 

(g,j)£A (g,j)eA 

- J2 l log G i(°J> 9\£j)\ "*(9,j) 

(g,j)&A:g&M 1 

+ ^ I lo g G i (°j > 9\£j) | • 7r (5 r , j) + max log Gj (oj , Oj \£j) 

(g,j)£A:g€M 2 

< Yl H(eo£J 9l \-Hg,j) 
{g,j)eA:geMi 

+ Yl I lo g(l - £ma X ) \-Tr(g,j) + max log Gj (oj , Oj |^ ) 
(g,j)eA:geM 2 

< Y^ |fog( £ o^mm)l • \g\ -n(gJ) 

(g,j)&A:g£Ah 

+ |fog(l -£max)| + maxlog Gj(0j,0j\Zj) < oo, 



since ]T\ .s g ^ |g|-7r(g,j) < oo; see [111, Proof of Prop. 3.2]. From this follows that l(Wk)/k 
tends to Ch almost surely. The next step is to show that 



(3.1) '""^ almost surely. 



n— >oo 



10 
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To prove this, assume now that we have the representations Ww n i = 51(72 • • • <7k(n) an d 
X„ = gig2 ■ ■ ■ g\,( n ) ■■■9\\x n \\- Define M := max{|log(e ^ la )|, | log(l -£ ma x)|}- Then: 

II V II 

A n\\ 



\l(X n ) - l(W Hn) )\ 



i=k(n)+l 

1 y 1 



log 



G r(gi){ r{ gi ),9i I £r( gi )) 



G rto0(°r(ff0. o T(fl0 Ifrfo)) 



2=k(n)+l 

II V II 
||-An II 

< ^ |logG r(9i) (o T(ft) ,^|e T(9l ))| 

2=k(n)+l:^€Mi 
II v II 

||^-n|| 

+ Y \ l °sG T{ g l ){o T{gt ),g l \^ Tigt) ) 

i=k(n)+l:ji£M 2 



+ (||X n ||-k(n))-|log(l-& 



II V I 

Aft 



< Y |log(eo^ in ) l9l| | 

i=\t(n)+l:gi€Mi 

11 v 11 
||A n || 

+ ^ |log(l-^ m ax)| + (||^ n ||-k(n))-|log(l-emax)| 

i=k(n)+l:gjGM 2 

ll-M ||A n || 

< Y \9i\-M+ Y M+(\\X n \\--k(n))-M 

i=k(n)+l:g i eM 1 j=k(n)+l:g;GM 2 

< 3- M ■ (n-e k(n) ). 

Dividing the last inequality by n and letting n — > 00 provides analogously to Nagnibeda 
and Woess [23j, Section 5] that lim n _ >00 (/(A' n ) — Z(W k ( n )))/n = almost surely. Recall 
also that k/e^ —> £q and ew n )/n — > 1 almost surely; compare [231 . Proof of Theorem D] 
and [111 . Prop. 3.2, Thm. 3.3]. Now we can conclude: 

l(X n ) l(X n ) - l(W k{n) ) Z(W k(n) ) k(n) e k(n) „_>«, 
(3.2) = — — I 1 ( \ — > Ch ■ £q almost surely. 



11 



n 



k(n) e kin) 



11 



□ 



We now compute the constant Ch from the last proposition explicitly: 



(sj')g^ iex 



(3.3) 



Y Y -WjfagtoW&f f-f 



a,- & 1 -£j , , . 



ijex, geV ^ 
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We conclude this subsection with the following observation: 

Corollary 3.3. The rate of escape £ is non-negative and it is the rate of escape w.r.t. the 
Greenian metric, which is given by dGreen( x ,y) '■= — ^og F (x , y\l) . That is, 

£ = lim logF(e,X n |l) > 0. 

n— >oo n 



Proof. By (|HIj) , we get 

£= lim --logF(e,X n \l) - -logG(X n ,X n \l) + -logG(o,o\l). 
n— >oo n n n 

Since F(e, X n \l) < 1 it remains to show that G(x, x\l) is uniformly bounded in x E V: for 
v, w E V, the first visit generating function is defined as 

(3.4) U(v,w\z) = ^>[X„ = w,Vm E {1, . . . ,n - 1} : X m ^ w \ X = v] z n . 

n>l 

Therefore, 



G(x,x\z) = Vf/(x,x|z) n = — 

*—i 1 — U(x 



U(x,x\z) 

n>0 v ' ' ' 

Since J7(x,x|^) < 1 for all z G [1,-R), f7(x,a;|0) = and C/(x,x|z) is continuous, stricly 
increasing and strictly convex, we must have U(x,x\l) < -^, that is, 1 < G(x,x\l) < 

(l — p) . This finishes the proof. □ 

3.2. Asymptotic Entropy. In this subsection we will prove that £ equals the asymptotic 
entropy, and we will give explicit formulas for it. The technique of the proof which we will 
give was motivated by Benjamini and Peres [2J, where it is shown that the asymptotic 
entropy of random walks on discrete groups equals the rate of escape w.r.t. the Greenian 
distance. The proof follows the same reasoning as in Gilch and Miiller [121 ]. 



Recall that we made the assumption that the spectral radius of (X n ) n ^ is strictly smaller 
than 1, that is, the Green function G(o, o\z) has radius of convergence R > 1. Moreover, the 
functions £i(z), i El, have radius of convergence bigger than 1. Recall that & = &(1) < 1 
for every i El. Thus, we can choose g E (1,-R) such that £i(g) < 1 for all i El. We now 
need the following three technical lemmas: 

Lemma 3.4. For all m,n E No, 

P im) (o,X n ) < G{o,o\q) ■ ( - l — Y ■ g- m 



1 -maxjei^(e) 

Proof. Denote by C g the circle with radius g in the complex plane centered at 0. A straight- 
forward computation shows for mGNo: 

1 I mdz J 1, if m, = 0, 
2Td?c B Z ~z I 0, if m ^ 0. 
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Let be x = si ... it G F. An application of Fubini's Theorem yields 
— i G(o,x\z)z- m — = —& YpW(o,x)z k z- m — 

iV/)(o,x) I z k - m —=p( m \o,x). 

im fri. Jc n z 



2m 

k>0 



Since G(o,x\z) is analytic on C g , we have \G(o, x\z)\ < G(o,x\g) for all \z\ = g. Thus, 

p {m) (o,x) < —■g- m - 1 -G(o,x\g) ■ 2irg = G(o,x\g) ■ g- m . 
Iterated applications of equations (|2.3j) and (|2.4p provide 

G{p,x\g) = G{p,o\g) J~[L T{xk) (o r{xk) ,x k \£,i(g)) <G{o,o\g)( — 

fc=l 

Since ||X n || < n, we obtain 

p( m \e,X n ) < G(o,o\g) ■ (- ^--) n • g~ m . 

□ 

Lemma 3.5. Let (A n ) n( ^, (a n ) ng N, (b n )neN be sequences of strictly positive numbers with 
A n = a n + b n . Assume that linin^oo — -logA n = c € [0,oo) and that \ivn n ^ CCl b n /q n = 
for all q G (0, 1). Then lim^oc ~ \oga n = c. 

Proof. Under the made assumptions it can not be that liminf n _s. 00 a n /q n = for every 
q € (0, 1). Indeed, assume that this would hold. Choose any q > 0. Then there is a subse- 
qence (a nft )fc e N with a nk /q nk — > 0. Moreover, there is N q € N such that a nk ,b nk < q nk /2 
for all k > N q . But this implies 

log(a„ fc +b nk )> log(q nk ) = -logq. 

The last inequality holds for every q > 0, yielding that lim sup,,^^ — ^ log A n = oo, a 
contradiction. 

Thus, there is some N € N such that b n < a n for all n > N. We get for all n > N: 

log(a n + 6 n ) < log(a„) = log (-a n + -a r 

n n n \2 2 

< log(-a n + -b n ) < log- log(a n + 6 n ). 

n \2 2 J n 2 n 

Taking limits yields that — - log(a n ) tends to c, since the leftmost and rightmost side of 
this inequality chain tend to c. □ 

For the next lemma recall the definition of K from (12.11). 
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Lemma 3.6. For n £ N, consider the function f n : V — >• M defined by 

f M ._ J-^ogE™Sp (m) (o,x), if P M(o,z)>0, 
I (J, otherwise. 

Then there are constants d and D such that d < f n (x) < D for all n £ N and iEV. 

Proof. Assume that p( n '(o, x) > 0. Recall from the proof of Corollary 13.31 that we have 
G(x,x\l) < (l — jj) • Therefore, 

Kn 2 

^2p {m) {o,x) <G(o,x\l) <F(o,x\l) -G(x,x\l) < r , 

m=0 1 ~ R 

that is 

fn{x) > log- -. 

n 1-H 
For the upper bound, observe that, by uniform irreducibility, x € V with p^ n '(o,x) > 
can be reached from o in JVa. < K ■ \x\ < -RTn steps with a probability of at least £q , 
where £q > from (12. ID is independent from x. Thus, at least one of the summands in 
Ylm=oP (o,x) has a value greater or equal to £q > £q. Thus, f n (x) < — logeo- D 

Now we can state and prove our first main result: 

Theorem 3.7. Assume R > 1. Then the asymptotic entropy exists and is given by 

h = io-J2 l(g)K{g,T(g))=£. 
gev* 

Proof. By (|2.4p we can rewrite £ as 

1= lim --logL(o,X n |l)= lim - - log G % \ \ ^ = lim -i logG(o,X n |l). 

n— >oo n n— >oo n G(0, 0|lj n-K» n 

Since 

G(o,X n |l) = Y,P {m \o,X n ) >p {n \o,X n ) = vr n (X n ), 

m>0 

we have 

(3.5) liminf logir n (X n ) > I. 

n— >oo 71 

The next aim is to prove limsup n _ >00 — iE[log7r n (X n )] < t. We now apply Lemma [331 by 
setting 

Kn 2 

A n :=Y,P (m) (o,X n ), a n :=Y,P (m) (o,X n ) and b n := £ p (m) (o,X n ). 

m>0 m=0 m>A"n 2 +l 

By Lemma 13.41 

b n < > h —r-r) = G(o,o\q)-[- — - • -^ . 

m>Kn / *4-l 
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Therefore, b n decays faster than any geometric sequence. Applying Lemma 13.51 yields 

Kn 2 

£= lim log / p^ m '(o,X n ) almost surely. 

n— »oo 77, *—^ 

By Lemma 13.61 we may apply the Dominated Convergence Theorem and get: 

Kn 2 



lim log V p^ (p, X n ) dP 

n— »oo 77- *— ' 

m=0 

= lim / log V p {m) (o, X n ) d¥ 

ri— >oo I 77, * — ' 

J m=0 

Kn 2 

= lim S^ p( n \o, a;) log S^ p( m ">(o, x). 

n— >oo 77 * — ' ^ — ' 

x£K m=0 

Recall that Shannon's Inequality gives 

- ^ p^ (o, x) log fi(x) > — y~" j p^ (o, x) log p^ (o, x) 

for every finitely supported probability measure \i on V. We apply now this inequality by 
setting /i(x) := 1? ^ TT Em=o^ (m) (°' x ) : 

£ > limsupi^^ n )(o,x)log(Kn 2 + l)-i^p( n )(o,x)log^")(o,x) 
n ^°° n xev n xev 

= lim sup / log 7r n (X n ) dF. 



Now we can conclude with Fatou's Lemma: 

i< [lunM - l ° S ^ Xn) dP < lunM [ - l ° gnn{Xn) dP 

J n— s-oo 77, n— >oo J 77 

(3.6) < lim sup / ~ log7rra(Xw V < £. 

Thus, linin^oo — -E[log7r n (X n )] exists and the limit equals £. The rest follows from (|3.2[) 
and (GO). " □ 



We now give another formula for the asymptotic entropy which shows that it is strictly 
positive. 

Theorem 3.8. Assume R > 1. Then the asymptotic entropy is given by 

h = £ - Y, -K{g,T(g))q{(g,T(g)),(h,T(h))) logq((g,T(g)),(h,T(h))) > 0. 

g,h£V* 
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Remarks: Observe that the sum on the right hand side of Theorem 13.81 equals the entropy 
rate (for positive recurrent Markov chains) of (Wfc,Tfc) fe6N , which is defined by the almost 
sure constant limit 

h Q := lim log// n ((Wi,Ti),... ,(W„,r„)), 

n— »oo n 

where /x n ((ffi, n), . . . ,(g n ,r n )) is the joint distribution of ((Wi,ti), . . . , (W n ,r n )). That 
is, h = £ ■ Hq. For more details, we refer e.g. to Cover and Thomas [6, Chapter 4]. 

At this point it is essential that we have defined the length function /(•) with the help of 
the functions L(x,y\z) and not by the Greenian metric. 



Proof. For a moment let be x = x\ . . . x n € V. Then: 

n 

l(x) = -log Y[L T ( Xj ){o T ( Xj ),Xj\Z T ( Xj )) 



3=1 



- i—TT aT ( x i) ^t(^--i) 1 ^fe) T / _ |> ^ 

- - iOg J_ J_ — — L t{xj) \°t(xj), x j\Zt(xj)) 

j = 2 a -r(zj_i) Sr(xj) X St(Xj_i) 

- log L T{xi) {0 t{xi) , XI \£ r ( Xl) ) + bg — — r- 

u r(il) Sr(x n ) K 1 Sr(xi)y 

3=2 

(3.7) -logir^^^xo.giMxoJ+iog — -77— r: N v 

We now replace x by X efe in the last equation: since l(X n )/n tends to h almost surely, the 
subsequence (/(X efc )/efc), „ converges also to h. Since minj g xCi > and maxj e x£j < 1, 
we get 

— log — - ' K ' v ' > almost surely, 

e fc Or(n) ?r(x fc ) (1 - ?r(x-i)) 

where xi := X ei and x^ := W^ = X ek . By positive recurrence of (Wfc,Tfe), „, an appli- 
cation of the ergodic theorem yields 



ilogn^^-x,^!),^,^)) 



i=2 
n— >oo , / 



> /i':=- ^ ^(9,T(g))q{(g,T(g)),(h,T(h))logq((g,T(g)),(h,T(h)) >0a.s., 

r(a)^r(h) 

whenever b! < oo. Obviously, for every x\ E V^ x 

lim log£ T ( !El )(o T ( a;i ),a:i|£ T ( a:i )) =0 almost surely. 
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Since lim^oo k/e^ = £q we get 

l(X Bh ) l(X e .) k 

h = lim V k > = lim V kJ — = ti ■ (o, 

k— >oo e/j k— >oo k e/j 

whenever h! < oo. In particular, h > since £o > by [111 . Section 4]. 

It remains to show that it cannot be that b! = oo. For this purpose, assume now b! = oo. 
Define for TV € N the function h N : (K x ) 2 -> R by 

M<?,^) :=iVA(-logg((r7,T( 5 )),(/ J ,T(/i))). 
Then 

1 k „ 



i=2 



fc— >oo 



» ti N := - ^2 n{g,T{g)) q((g,T(g)),(h,T(h))) logh N (g,h) almost surely. 

r{g)frr{h) 

Observe that h' N -> oo as JV -> oo. Since hj^(g,h) < — log q((g,T(g)),(h,T(h))) and 
b! = oo by assumption there is for every M € R and almost every trajectory of (W^), N 
an almost surely finite random time T q £ N such that for all k > T q 

k 

(3.8) - ^togg^-i.rj-O.CW^rj)) > M. 

3=2 

On the other hand side there is for every M > 0, every small e > and almost every 
trajectory an almost surely finite random time Tl such that for all k > Tl 

1 k 
—-J2 lo S L T(x ei )(or(x e A,X ej \Cr(x ei )) G (h-e,h + e) and 

J = l 



A: 



^logg((Xe i _ 1 ,T i _i),(X ejJ r i )) 



k 1 



i=2 



— -^logg((X e ._ 1 ,r i -i),(X e . ! T i ))>4-M. 



J'=2 

Furthermore, since minj e j£j > and maXj G x£j < 1 there is an almost surely finite random 
time T e > Tl such that for all k > T £ and all xi = X ei and Xk = X ek 

log { ' ( ' n t^ G (-£, e) and 

e fc «r(xi) 4r(x fc ) I 1 - 4r(a-i)j 

— logL T ( xl )(o r ( Xl ),xi\€ T ( xl )) G (-e,e). 

Choose now M > (/i + 3s) /£q. Then we get the desired contradiction, when we substitute 
in equality (J3.T|) the vertex x by X efc with k > T e , divide by e^ on both sides and see that 
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the left side is in (h — e,h + e) and the rightmost side is bigger than h + e. This finishes 
the proof of Theorem 13.81 □ 

Corollary 3.9. Assume R > 1. Then we have for almost every path of the random, walk 

(^n)neNo 

, ,. . f logvr n (X n ) 
h = iim mi . 

n—s-oo n 

Proof. Recall Inequality (13, 5p . Integrating both sides of this inequality yields together with 
the inequality chain (|3.6p that 

hminf- 1Og7r " (X " ) -^P = 0, 

n— >oo n 

providing that h = liminfn^oo — log7r n (X ri ) for almost every realisation of the random 
walk. □ 

The following lemma gives some properties concerning general measure theory: 

Lemma 3.10. Let (Z n ) nS N be a sequence of non-negative random variables andO < c € R. 
Suppose that liminfn^oo Z n > c almost surely and \\m. n ^ OCl W\Z ri \ = c. Then the following 
holds: 

F 

(1) Z n — > c, that is, Z n converges in probability to c. 

(2) If Z n is uniformly bounded then Z n — h- c, that is, f\Z n — c\dP — > as n — > oo. 

Proof. First, we prove convergence in probability of (Z n ) ne pj . For every 8\ > 0, there is 
some index N$ ± such that for all n > N§ 1 



J Z n dPe (c-5i,c + <5i). 



Furthermore, due to the above made assumptions on (Z n ) nG N there is for every 82 > 
some index N$ 2 such that for all n > Ng 2 

(3.9) F[Z n >c-5 1 }>l-5 2 . 

Since c = linin^oo J Z n dF it must be that for every arbitrary but fixed e > 0, every S\ < e 
and for all n big enough 

P[Z n >c-5i] -(c-5i) + P[Z n >c + e] -(e + Sx) < I Z n dP<c + 5 u 

or equivalently, 

r n c + S 1 -P\Z n >c-8 1 ]-(c-6 1 ) 

F[Z n >c + e] < l — -^ -. 

L J e + <5i 

Letting 82 — > we get 

9A 

limsupP[Z n >c + e] < "" ' 



e + dt 
Since we can choose 5\ arbitrarily small we get 

F[Z n > c + e] ^^> for all e > 0. 
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This yields convergence in probability of Z n to c. 

In order to prove the second part of the lemma we define for any small e > and n € N 
the events 

A n>£ := [\Z n - c\ <e] and B n ^ £ := [\Z n - c\ > e] . 

For arbitrary but fixed e > 0, convergence in probability of Z n to c gives an integer 
N e G N such that P[-B n ,e] < £ for all n > N e . Since < Z n < M is assumed to be 
uniformly bounded, we get for n > N £ : 

\Z n -c\dF= \Z n -c\dF+ \Z n -c\aT <e + e{M + c) ^> 0. 

Thus, we have proved the second part of the lemma. □ 

We can apply the last lemma immediately to our setting: 

Corollary 3.11. Assume R > 1. Then we have the following types of convergence: 

(1) Convergence in probability: 

1 p 

log7r„(X n ) -> h. 

n 

(2) Assume that there is cq > such that p(x,y) > cq whenever p(x,y) > 0. Then: 

log7r n (X n ) -h h. 

n 

Proof. Setting Z n = —^logir n (X n ) and applying Lemma T3.10I yields the claim. Note that 
the assumption p(x,y) > Co yields < ~ og ^" < — logco- □ 

The assumption of the second part of the last corollary is obviously satisfied if we consider 
free products of finite graphs. 

The reasoning in our proofs for existence of the entropy and its different properties (in par- 
ticular, the reasoning in Section f3.2[) is very similar to the argumentation in [12|. However, 
the structure of free products of graphs is more complicated than in the case of directed 



covers as considered in [12| . We outline the main differences to the reasoning in the afore- 
mentionend article. First, in [12] a very similar rate of escape (compare [12l . Theorem 3.8] 
with Proposition 13. 2|) is considered, which arises from a length function induced by last 
visit generating functions. While the proof of existence of the rate of escape in [l2| is easy 
to check, we have to make more effort in the case of free products, since — log Lj(oj, x\l) is 
not necessarily bounded for x G V{. Additionally, one has to study the various ingridients 
of the proof more carefully, since non-trivial loops are possible in our setting in contrast 



to random walks on trees. Secondly, in 12| the invariant measure n(g, r(g)) of our proof 
collapses to u(r(g)), that is, in [12] one has to study the sequence ( T (^k)) k eN , while 
in our setting we have to study the more complex sequence (Wfc,r(Wfc)), „; compare 
[12l . proof of Theorem 3.8] with Lemma 13. II and Proposition 13.21 
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4. A Formula via Double Generating Functions 
In this section we derive another formula for the asymptotic entropy. The main tool is the 



following theorem of Sawyer and Steger [25l . Theorem 2.2]: 



Theorem 4.1 (Sawyer and Steger). Let (In)neNo be a sequence of real-valued random 
variables such that, for some 5 > 0, 

E f ^ exp(-r-y n - sn))= . ' . for < r, s < 5, 

v n>0 7 yV ' ; 

where C(r, s) and g(r, s) are analytic for \r\, \s\ < 5 and C(0, 0) ^ 0. Denote by g' r and g' s 
the partial derivatives of g with respect to r and s. Then 

Y n n^oo g' r (0,0) , , , 

> — — almost surely. 

n g> s (0,0) 

Setting z = e~ s and Y n := — logL(o, X n |l) the expectation in Theorem 14. II becomes 

e(r,z) = ^^p (n) (o,x)L(o,x!l) r z" = ^G{o,x\z)L{o,x\l) r . 
xeVn>o xev 

We define for i € X, r, z € C: 

n 
C(r,z) := 1 + Y^ Y^ YLLrfrrtiOrfrfrXjlirfa^z)) ■L T ( x . ) (o T ( x . ) ,x j \€ T ( x . ) ) r , 

n>l xi...x n £V\{o} 3=1 

Cf(r,z) := ^2 Li{oi,x\€i(z))Li(oi,x\£i) r '. 

x£V* 

Finally £j(r, z) is defined by 



£f(r,z) 



1 + X] ^ W L r{x ] ){o T l yX]) ,X j \i T{xj) {z)) •L T(:Cj) (o T(:! . j) ,X i |C T ( a;j )) r J. 

t>~>9 _ _ ^I«l f.l n—O ' 



n>2 X2 ... Xn £V x \{o},j=2 
t(x2)^i 



With these definitions we have C(r, z ) = 1 + ^2 ie x A(?*> z ) an d £(r, z) = G(o, o\z) ■ C(r, z). 



Simple computations analogously to III, Lemma 4.2, Corollary 4.3] yield 



G(o,o\z) ^ £t(r,z) 
£{r, z) = — -. r, where £ (r, z) = > —_ r 



iex 
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We now define C(r,z) := G(o,o\z) and g(r,z) := 1 — C*(r, z) and apply Theorem 14.11 by 
differentiating g(r, z) and evaluating the derivatives at (0, 1): 

^xev* L i{oi,x\^i) ■ log Li(oi,x\ii) 



dg(r, z) 



Or 



r=0,z=l 



^2Gi(oi,Oi\£i) ■ (1 -£if ■ ^2 Gi(oi,x\£i) log Li(oi,x\£i 



iex 



} y Gi(oi,x\€i)logGi(oi,x\£i) 

xeVi 



log Gi(oi,Oj\£i 
1-6 



%(r, 2) 



a.s 







r=0,s=0 



iex 



^ — (l-(l-&(z))G,,( 0i , 0i |&(z) 



2=1 



2 e-(l) • (Gite, Oi|&) - (1 - 6)^(0*, 0(|6)) • 



Corollary 4.2. Assume R > 1. TTien f/te entropy can be rewritten as 

h 



^£2(0,1) 



0> z ) 



a« 



(0,1) 



n 



5. Entropy of Random Walks on Free Products of Groups 

In this section let each Vi be a finitely generated group T, with identity e-i = Oj. W.l.o.g. 
we assume that the V^'s are pairwise disjoint. The free product is again a group with 
concatenation (followed by iterated cancellations and contractions) as group operation. 
We write T* := T, \ {e,}. Suppose we are given a probability measure \X{ on Y{ \ {e{\ for 
every i € 1 governing a random walk on Tj, that is, Pi(x,y) = /Xj(x _1 y) for all x,y G IV 
Let (aj)i e x be a family of strictly positive real numbers with Yliex a i = 1- Then the 
random walk on the free product T := T\ *■ ■ -*V r is defined by the transition probabilities 
p(x,y) = n(x~ 1 y), where 



fj,(w) 



ami{w) 
0, 



ifwer 



i ' 



otherwise. 



Analogously, /i' n ' denotes the n-th convolution power of \x. The random walk on Y starting 
at the identity e of T is again denoted by the sequence (X n ) n€ ^ . In particular, the radius 
of convergence of the associated Green function is strictly bigger than 1; see [29J, Theorem 
10.10, Corollary 12.5]. In the case of free products of groups it is well-known that the 
entropy exists and can be written as 



h = lim ■ 
n— >oo 



l0g7T n (X r , 



n 



lim ■ 

n— >oo 



logF{e,X n \\) 



n 
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see Derriennic [3], Kaimanovich and Vershik [141 ] and Blachere, Ha'issinsky and Mathieu 
[3]. For free products of finite groups, Mairesse and Matheus [21|] give an explicit formula 
for h, which remains also valid for free products of countable groups, but in the latter case 
one needs the solution of an infinite system of polynomial equations. In the following we 
will derive another formula for the entropy, which holds also for free products of infinite 
groups. 

We set l(gi . . . g n ) := — logF(e, <?i . . .g n \l). Observe that transitivity yields F(g,gh\l) = 
F(e,h\l). Thus, 

n n 

l(9l---9n) = -logY[F(g 1 ...g j _ 1 ,gi...g j \l) = - ^logF(e, 5j |l). 

3=1 3=1 

First, we rewrite the following expectations as 

m(x n ) = x^X>^)X^(^ (n) (/o, 

iei geTi her 

W(X n+1 ) = Y,Y,°^^)Y, l ^h)^ n) {h). 

iei gev, her 

Thus, 

m(X n+l ) - El(X n ) = J2Y1 a M9)J(l(9h) - 1(h)) d^ n \h) 



iei ger l 



F(e,gX n \l) (n) 



(w) - S^*/-S W |i) 

Recall that \\X n \\ — > oo almost surely. That is, X n converges almost surely to a random 

infinite word X^ of the form x\X2 ■ ■ • £ I UI=i F* ) > where two consecutive letters are 

not from the same r*. Denote by Xso the first letter of X^. Let be g £ Tf . For n > e±, 
the integrand in (|5.1|) is constant: if ryXoo ) ^ i then 

log ^fe^]iT = logi?(e ' 5) ' 



(lb 



and if r (Xqo ) = i then 



F(e,gX w |l) _ F(e, g X^|l) 
°' 5 Fie^l) - ° g F (e,xW|l) 



') 7i n 



By III, Section 5] , for i £ Z and g £ T x 



g(i) := P[X« £ rj = 1 - (1 - &) G 4 ( 0i , 0i |^) and 

p[^=ff] = i ? (o 4 ,5ie 4 )(i-^)G 4 (o i , 0i ^) = (i-e 4 )G 4 ( 0i , 5 ie 4 ). 

Recall that -F(e,<7|l) = Fi(oi,g\£i) for each g € Tj. We get: 
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Theorem 5.1. Whenever hi := — Eger • wCflO^g w(ff) < °° / or a ^ i £F, that is, when 
all random walks on the factors Tj have finite single-step entropy, then the asymptotic 
entropy h of the random walk on T is given by 



h = -^2^2an2i(g) (l-g(i)) log Fi(oi,g\£i) + (1 - &) Gi(oi,Oi\Ci) F(g) 



where 



(5.2) 



F(g):= Y, ^o i ,g%)lo Z F l { y 9 2 i : for gel, 



s'er? 



Fi{oi,g%) 



Proof. Consider the sequence El(X n+ i) — Kl(X n ). If this sequence converges, its limit must 
equal h. By the above made considerations we get 



Ei(x n+1 ) - m(x n ) 

-J212^9)\(l-Q(i))logF l (o, l ,g\^+ £ P[X« = g'} log 



«ez ser^ 



ff'er? 



Fi(oi,g'\tii) 



if the sum on the right hand side is finite. We have now established the proposed for- 
mula, but it remains to verify finiteness of the sum above. This follows from the following 
observations: 

Claim A: -X^ezX^er* oafii(g)(l ~ £(*)) log Fi(oi, g\&) is finite. 

Observe that Fi(oi,g\£i) > [J>i(g)£i for g € supp( / u i ). Thus, 

< - ^ Hi(g) log Fi(oi,g\€i) < - 5Z Viid) log {m(g)ti) = K -log&. 



This proves Claim A. 

Claim B: Ei e xE 9G r, <*»/*» (s)(l - &) E g ' € r x G i(°i;5'l& 



log 



*i(°i,S%) 



is finite. 



Observe that Fi(oi,^'|^)/Fj(oj, g'\^) = Gi(oi,gg'\£i)/Gi(oi,g'\£i). Obviously, 



» 



nrtf)&<GiM\ti)< 



i-6 



for every n € N and g' G IV 
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For g € T set N (g) := {n G N | M (n) (#) > 0}. Then: 
< Y, nX ( £=9'\-\\ogG l (o l ,g'\^ i )\ 

= E (W;)-G^,</|&)-|logG;( 0i ,<7% 



g / G r 8 x neAT(g') 

< £(!-&)■ E ^ (n) (5 / )-e-max{-log(^ ) ( 5 ')e),-log(l-e,)} 
p'grf neN(g>) 

< (i-6)- E ^er-^E^^oiog^^o-a-^iog^E"^ 

neN(g') g'&i ra>l 

V v ' 

(*) 
-(l -6) iog(i -&)£#■ 

n>l 

Recall that hi < oo together with Kingman's subadditive ergodic theorem implies existence 
of a constant Hi > with 

(5.3) lim -- J2 nt\a)\og^ l \g) = H t . 

Thus, if n £ N is large enough, the sum (*) is in the interval (Hi — e,Hi + e) for any 
arbitrarily small e > 0. That is, the sum (*) is uniformly bounded for all n € N. From this 
follows that the rightmost side of the last inequality chain is finite. 

Furthermore, we have for each g € Tj with /j,\ n \g) > 0: 

o < y ^[^ ) = </H 1 °g G '*( < wieo| 

= Y ^-ii)-G i {o i ,g'\i i )-\\ogG i {o i ,gg'\i i )\ 

= E0--&)- E ^\9')-^-HG i (o i ,gg%)\ 

g / G r 8 x neN(g') 

< E^-^- E ^ n) (5 / )-4 n -max{-log(^( 5 )^ n) ( 5 ')er +1 ),-log(l-^)} 

g'eTf neN(g>) 

< -(i-6)- E c-E^ n) ^)iog^ n) (5')-(i-^)-iog^-E( n+1 )^ 

neN(g') g'£T x n>l 

-logm(g) -log(l-&). 
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If we sum up over all g with fi(g) > 0, we get: 

-EE«^)(i-a) E eE^Oiog/tV) 

ieXg£Yi neN{g>) g'&i 

^ v ' 

(I) 

E E «i^te)(i -&) iog^E( n+1 )^ 

iGX ger^ n>l 



(JJ) 



E «j E ^(#) log ^(#) ~ E a * 1 °s( 1 ~ &) • 

N / S .. ' 



(777) <°° 

Convergence of (I) follows from (|5.3p . (I/) converges since £j < 1 and (/iT) is convergent 
by assumption /ij < oo. This finishes the proof of Claim B, and thus the proof of the 
theorem. □ 

Erschler and Kaimanovich [9fl asked if drift and entropy of random walks on groups depend 
continuously on the probability measure, which governs the random walk. Ledrappier [19| 
proves in his recent, simultaneous paper that drift and entropy of finite-range random 
walks on free groups vary analytically with the probability measure of constant support. 
By Theorem 15 .1\ we are even able to show continuity for free products of finitely generated 
groups, but restricted to nearest neighbour random walks with fixed set of generators. 

Corollary 5.2. Let Tj be generated as a semigroup by Si. Denote by V% the set of 
probability measures \xi on Si with fJ,i(xi) > for all Xi € Si. Furthermore, we write 
A := {(ai, . . . , a r ) \ a, t > 0, Yliti a i = !}■ Then the entropy function 

/i:ixP 1 x---xP r ->R: (ai, . . . ,a r ,ni,... ,fi r ) h ^ h(a%, . . . ,a r ,//i, . . . ,/i r ) 

is real- analytic. 

Proof. The claim follows directly with the formula given in Theorem 15.11 the involved 
generating functions Fi(oi,g\z) and Gi(oi,Oi\z) are analytic when varying the probability 
measure of constant support, and the values £j can also be rewritten as 

\Si\ 

ki,...,kr,h,i,—,l r> \8 r \>l iel j=l 

where Si = {xi,i, . . . , x^ asa}- This yields the claim. □ 

Remarks: 

(1) Corollary 15.21 holds also for the case of free products of finite graphs, if one 
varies the transition probabilities continously under the assumption that the sets 
{(xi, yi) € Vi x Vi | Pi(xi,yi) > 0} remain constant: one has to rewrite & as power 
series in terms of (finitely many) Pi(xi,yi) and gets analyticity with the formula 
given in Theorem 13.71 
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(2) Analyticity holds also for the drift (w.r.t. the block length and w.r.t. the natu- 
ral graph metric) of nearest neighbour random walks due to the formulas given 



m 



111 . Section 5 and 7]. 
(3) The formula for entropy and drift given in Mairesse and Matheus [2l|] for random 
walks on free products of finite groups depends also analytically on the transition 
probabilities. 

6. Entropy Inequalities 

In this section we consider the case of free products of finite sets V\ , . . . , V r , where V% has 
|Vi| vertices. We want to establish a connection between asymptotic entropy, rate of escape 
and the volume growth rate of the free product V. For n G No, let So(n) be the set of 
all words of V of block length n. The following lemmas give an answer how fast the free 
product grows. 

Lemma 6.1. The sphere growth rate w.r.t. the block length is given by 

s := hm = logAo, 

n-+oo n 

where Ao is the Perron- Frobenius eigenvalue of the r x r-matrix D = (dij)i<.ij<. r with 
dij = for i = j and dij = \Vj\ — 1 otherwise. 

Proof. Denote by D the r x r-diagonal matrix, which has entries | V\ \ — 1, | V2 \ — 1, ■ ■ ■ , | V r \ — 1 
on its diagonal. Let 1 be the (r x l)-vector with all entries equal to 1. Thus, we can write 

\S ( y n)\ = t T DD n - 1 t. 

Let < v\ < 1 and v 2 > 1 be eigenvectors of D w.r.t. the Perron-Frobenius eigenvalue Ao- 
Then 

|Sb(n)| > l T DD n ~ 1 vi = C 1 -XS~ 1 , 

\S (n)\ < t T DD n ~ 1 V2 = C 2 -X^ 1 , 
where C\,C2 are some constants independent from n. Thus, 

log I So (n) I . . .,]_/„ n^oo^ . . 

=log So(n) i/n » logA . 

n 

D 

Recall from the Perron-Frobenius theorem that Ao > Yll=i i^A\^i\ ~ 1) f° r eacri 3 € ^Tj i n 
particular, Ao > 1. We also take a look on the natural graph metric and its growth rate. 
For this purpose, we define 

Si(n) := {xeV\p( n \o,x) >0,Vm<n:pH( o ^) = }, 

that is, the set of all vertices in V which are at distance n to the root o w.r.t. the natural 
graph metric. 

We now construct a new graph, whose adjacency matrix allows us to describe the ex- 
ponential growth of Si(n) as n — )• 00. For this purpose, we visualize the sets Vx,...,V r 
as graphs Xi,...,X r with vertex sets Vi,...,V r equipped with the following edges: for 
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x,y € Vi, there is a directed edge from x to y if and only if Pi(x,y) > 0. Consider now 
directed spanning trees 71 , . . . , % of the graphs X\ , . . . , X r such that the graph distances 
of vertices in % to the root Oj remain the same as in X{. We now investigate the free 
product T = 71 * • • • * Tri which is again a tree. We make the crucial observation that T 
can be seen as the directed cover of a finite directed graph F, where F is defined in the 
following way: 

(1) The vertex set of F is given by {o} U Uigx V? w ith root o. 

(2) The edges of F are given as follows: first, we add all edges inherited from one of 
the trees 71 , • • • , % , where o plays the role of Oi for each i£l. Secondly, we add 
for all i £ X and every x € V* an edge from x to each y € V x , j ^ i, whenever 
there is an edge from 0{ to y in Tj. 

The tree 7" can be seen as a periodic tree, which is also called a tree with finitely many 
cone types; for more details we refer to Lyons [2CJ] and Nagnibeda and Woess [23J]. Now 
we are able to state the following lemma: 

Lemma 6.2. The sphere growth rate w.r.t. the natural graph metric defined by 

log | Si (n) | 
s\ := lim 

n— >oo n 

exists. Moreover, we have the equation s\ = logAi, where Ai is the Perron- Frobenius 
eigenvalue of the adjacency matrix of the graph F. 

Proof. Since the graph metric remains invariant under the restriction of V to 7" and since 
it is well-known that the growth rate exists for periodic trees (see Lyons [20, Chapter 3.3]), 
we have existence of the limit s±. More precisely, |Si(n)| ' n tends to the Perron-Frobenius 
eigenvalue of the adjacency matrix of F as n — > oo. For sake of completeness, we remark 
that the root of T plays a special role (as a cone type) but this does not affect the 
application of the results about directed covers to our case. □ 

For i £ {0, 1}, we write Bi(n) = Ufc=o Si(fe). Now we can prove: 

Lemma 6.3. The volume growth w.r.t. the block length, w.r.t. the natural graph metric 
respectively, is given by 

v IggjgoMJ i x r l0 S\Bi(n)\ 

go := nm = logAo, gi := urn = logAi respectively. 

n— >oo n n— >oo n 

Proof. For ease of better readability, we omit the subindex i 6 {0, 1} in the following, 
since the proofs for go and g\ are completely analogous. Choose any small e > 0. Then 
there is some K E such that for all k > K £ 

k „—ke s" I ai"L\\ s~ \k „ke 



\ k e- k£ < \S(k)\ < X k e k£ . 
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vfC-1 



Write C £ = £i=o \S(i)\. Then for n > K e : 

\B{n)\ l/n 



\ 



JZism 



< « 



fc=0 



\ 



C £ + Yj ^^ = ^ A 



k=K E 



\ 



\n e ne / ■* \n—kp(n—k)e 



< Xe £ 



a 



\ n e r - 



+ {n-K £ + l) ^^ Xe £ . 



In the last inequality we used the fact A > 1. Since we can choose e > arbitrarily small, 
we get limsup n _ > . 00 l-B(n)! 1 '" < A. Analogously: 



\B(n)\ l l n > » 



N 



C, + VJ AV 



fcc 



Ar 



fc=X e 



\| 



C £ ^-\ e 



6 n— >oo 



k=K e 



> Ae" 



That is, limn^oo | log |-B(n)| = log A. 



D 



For i G {0, 1}, define l { : V ->• N by Z (x) = ||z|| and J x (x) = inf{m G N | p (m) (o,^) > 0}. 
Then the limits £{ = lim n - ) . 00 li(X n )/n exist; see [ll|, Theorem 3.3, Section 7.II]. Now we 
can establish a connection between entropy, rate of escape and volume growth: 

Corollary 6.4. h < go ■ £q and h < g\ ■ t\. 

Proof. Let be i G {0, 1} and e > 0. Then there is some N e G N such that for all n > N e 
1-e < P({x G 7 | -logvr n (x) > (/i-e)n,Ii(x) < (4 + e)n» < e- (/l ~ £)n • |fli((4 + e)n)|. 
That is, 



n (£j + e)n 

If we let n tend to infinity and make e arbitrarily small, we get the claim. 



□ 



Finally, we remark that an analogous inequality for random walks on groups was given 
by Guivarc'h [13J, and more generally for space- and time-homogeneous Markov chains by 
Kaimanovich and Woess [15l . Theorem 5.3]. 



7. Examples 

7.1. Free Product of Finite Graphs. Consider the graphs X\ and X2 with the transi- 
tion probabilities sketched in Figure 17.11 We set a% = 02 = 1/2. For the computation of 
Iq we need the following functions: 






£l__l 
2 l-2 2 /2' 

2/2 



1 z ^M 2 1 

2 2 l- 42 ( z )3/2 



F 2 (/ii,o 2 |z) 



2 1-2^/2' 
2/2 



2 2 1-^(2)2/2 



2* 
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Figure 1. Finite graphs X\ and X 2 



Simple computations with the help of 11, Section 3] and Mathematica allow us to 
determine the rate of escape of the random walk on X\ * X 2 as £q = 0.41563. For the 
computation of the entropy, we need also the following generating functions: 

-v2 



Li(oi,gi\z) 



L 2 (o 2 ,h 2 \z) 



l-z 2 /2 : 

~2 



Li(oi,g 2 \z) 



-, L 2 (o 2 ,h 3 \z) 



l-z 2 /2 : 
z 3 /2 



L 2 {o 2 ,hx\z) 



l-2 3 /2' 



l-z 3 /2' -'v*''"""' l-z 3 /2' 
Thus, we get the asymptotic entropy as h = 0.32005. 

7.2. (Z x Z/2) * (Z x Z/2). Consider the free product r = T\ * T 2 of the infinite groups 
Ti = Z x (Z/2Z) with a, = 1/2 and ^((±1,0)) = ^((0, 1)) = 1/3 for each % € {1,2}. We 
set a := (1,0), b : = (1, 1), c := (0, 1) and X(x,y) := x for (x,y) G Tj. Define 



F(a[z) := ^P[y n =o,Vm<n: \{Y m ) < l\Y = (0,0)] z n , 
n>l 

F(6|z) := ^P[y n = 5,Vm<n:A(y m )<l|y = (0,0)]z n , 

,~ \ 1 



n>l 

where (l^)neN is a random walk on Z x Z/2 governed by /ii. The above functions satisfy 
the following system of equations: 

F{a\z) = ^(l + F(b\z) + F(a\z) 2 + F(b\z) 2 y 

F{b\z) = -(P{a\z)+F{a\z)F{b\z) + F(b\z)F{a\z)\. 

From this system we obtain explicit formulas for F(a\z) and F(b\z). We write F(n,j\z) := 
Fi((0,0), (n, j)\z) for (n,j) G Z x Z/2. To compute the entropy rate we have to solve the 
following system of equations: 

F(a\z) = ^(l + F(b\z) + F(a\z)F(a\z)+F(b\z)F(b\zj), 
F(b\z) = ~(f(c\z) + F(a\z) + F(a\z)F(b\z) + F(b\z)F(a\zj) , 

F(c\z) = Z -(l + 2F(b\z)). 
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Moreover, we need the value £i(l) = £2(1) = £• This value can be computed analogously 



to [Hi, Section 6.2], that is, £ has to be computed numerically from the equation 



' £Gi(£) ' 



2-2£ — 1 - iZF(a\0 - lZF(c\0 

Solving this equation with Mathematica yields £ = 0.55973. To compute the entropy we 
have to evaluate the functions F{g\z) at z = £ for each g € Z x Z2. For even n E N, we 
have the following formulas: 

n/2 



F((±«,0)|£) = J2(2k) P{m2kp{a ^ )n ~ 2k + 

fc=0 ^ ' 

F((±n,m) = E L k n +1 )Hb\0 2k+1 F(a\0 n - 2k - 1 + 

n/2 

E Ufe r wo^mo^^mo- 



fc=0 
ra/2-1 



fc=0 

For odd n E N, 

(n-l)/2 



F((±n,0)|0 = J2 ^^lO^MO"""^ 

fc=o ^ ' 

E L+ iWio^^ho"- 2 *- 1 ^), 

V /t— x)/2 . . 

^((±n,i)ie) = E L k n +1 )Hb\o 2k+1 Ha\o n ' 2k ' 1 + 

-l)/2 , v 

E (" wio^io^Mcio. 

1 — n \ / 



Moreover, we define F := P[3n E N : X(X n ) = 1]. This probability can be computed by 
conditioning on the first step and solving 

F = Ul + F + F 2 ), 

that is, F = 0.24291. Observe that we get the following estimations: 

Fi{o,g\i) < F |A(s)l forj€ZxZ 2l 

Fi(o,g\0 > Fl^l-^minlF^o^alO^i^i^lO} for 5 E (Z x Z 2 ) \ {(0,0),c}. 
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These bounds allow us to cap the sum over all g' G r* in (|5.2|) and to estimate the tails 
of these sums. Thus, we can compute the entropy rate numerically as h = 1.14985. 
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